A quasi-Newton method with optimal r-order without independence assumption∗

نویسندگان

  • Andreas Griewank
  • Sebastian Schlenkrich
  • Andrea Walther
چکیده

Quasi-Newton methods based on least change secant updating formulas that solve linear equations Ax = b in n = dim(x) = dim(b) steps can be expected to solve corresponding smooth nonlinear systems n-step quadratically, i.e. with an r-order of ρ = 2 = 1 + 1/n+O(1/n). The best rate one can possibly expect on general problems is given by the positive root ρn of ρ (ρ− 1) = 1, for which ρn − 1 = ln(n)/n+O(1/n). To show that this upper bound is actually achieved one usually has to impose a priori some kind of linear independence condition on the sequence of steps taken by the quasi-Newton iteration in question. Without any such assumptions we establish in this paper the convergence order ρn for the two-sided rank one formula proposed by Schlenkrich et al in [SGW06]. It requires the evaluation of adjoint vectors, is invariant with respect to linear transformations on the variable domain and combines the properties of bounded deterioration and heredity.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

A class of multi-agent discrete hybrid non linearizable systems: Optimal controller design based on quasi-Newton algorithm for a class of sign-undefinite hessian cost functions

 In the present paper, a class of hybrid, nonlinear and non linearizable dynamic systems is considered. The noted dynamic system is generalized to a multi-agent configuration. The interaction of agents is presented based on graph theory and finally, an interaction tensor defines the multi-agent system in leader-follower consensus in order to design a desirable controller for the noted system. A...

متن کامل

The Sine-Cosine Wavelet and Its Application in the Optimal Control of Nonlinear Systems with Constraint

In this paper, an optimal control of quadratic performance index with nonlinear constrained is presented. The sine-cosine wavelet operational matrix of integration and product matrix are introduced and applied to reduce nonlinear differential equations to the nonlinear algebraic equations. Then, the Newton-Raphson method is used for solving these sets of algebraic equations. To present ability ...

متن کامل

An Unconstrained Minimization Approach to the Solution of Optimization Problems with Simple Bounds

A new method for the solution of minimization problems with simple bounds is presented. Global convergence of a general scheme requiring the solution of a single linear system at each iteration is proved and a superlinear convergence rate is established without requiring the strict complementarity assumption. The theory presented covers Newton and Quasi-Newton methods, allows rapid changes in t...

متن کامل

Joint Independent Subspace Analysis: A Quasi-Newton Algorithm

In this paper, we present a quasi-Newton (QN) algorithm for joint independent subspace analysis (JISA). JISA is a recently proposed generalization of independent vector analysis (IVA). JISA extends classical blind source separation (BSS) to jointly resolve several BSS problems by exploiting statistical dependence between latent sources across mixtures, as well as relaxing the assumption of stat...

متن کامل

Fixed point theorems for generalized quasi-contractions in cone $b$-metric spaces over Banach algebras without the assumption of normality with applications

In this paper, we introduce the concept of generalized quasi-contractions in the setting of cone $b$-metric spaces over Banach algebras. By omitting the  assumption of normality we establish common fixed point theorems for the generalized quasi-contractions  with the spectral radius $r(lambda)$ of the quasi-contractive constant vector $lambda$ satisfying $r(lambda)in [0,frac{1}{s})$  in the set...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2006